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SYSTEM FOR SCHEDULING MULTIPLE 
TIME DEPENDENT EVENTS 



Backproiinfl nf the Tnventinn 

(1) Field of the Tnventinn 

This invention relates to a system for scheduling multiple events. More 
particularly, the invention relates to a system for scheduling multiple events in view 
of a series of constraints imposed upon the schedule. Still more particularly, the 
present invention describes a system for scheduling multiple events while at the same 
time optimizing some user-defined measure of the schedule's quahty, such as time to 
complete the schedule or cost to complete the schedule. 

(2) Description nf th e Prior Art 

Scheduhng problems are exemplified by the traditional traveUng salesman 
problem (TSP). The goal of the TSP is to find the minimal cost tour of n cities in 
which a salesman visits each city exactly once and returns to the starting city at the 
end of the tour. The time dependent TSP (TDTSP) is a variant of the TSP in which 
the salesman must still visit each city, but the cost of ti-aveling from one city to the 
next depends on both the distance between cities and the time of day when the travel 
takes place. When solving the TDTSP, a city - or "node" - is typically designated 
the "depot" node, where the salesman begins and ends his tour. 

Many real-world instances of the TDTSP are concerned with scheduling time- 
dependent tasks, including the process of scheduhng manufacturing jobs on a machine 
with time-dependent setup costs. One special instance of the TDTSP, known as the 
deliveryman problem (DMP), has been used to route guided vehicles through a 
manufacturing system. Other applications of the TDTSP include routing data through 
a network, creating timetables for university exams, and scheduling vehicles and 
crews. 

Certain properties exploited in TSP heuristics cannot be extended to the 
TDTSP. Thus, different heuristics are needed to generate solutions to general 
TDTSPs with more than a few dozen cities. 

One approach to solving both the TSP and TDTSP is the adoption of 
enumerative or so-called "brute force" methods. These methods simply search (i.e., 
enumerates) every possible solution within the solution space. The obvious drawback 



to these methods is that they are not practical for most real-world problems, as the 
search space is too large to be enumerated. 

Another method is the random search. Because a random search cannot 
efficiently save every promising solution it finds, simple random searches do no better 
; than enumerative schemes. While random searches can search a large space 

effectively, they lack the tools necessary to exploit the more promising areas of that 
space. 

Malandraki and Daskin described several straightforward modifications of the 
TSP heuristic to the TDTSP, including the standard nearest-neighbor (NN), a 
variation, known as NN2 that evaluates the cost of paths when each city is guaranteed 
to be the first city visited after leaving the depot, and a probabilistic nearest neighbor 
heuristic (NNR) that selects the next city to be visited randomly, according to a user- 
defined probability fimction. Test results on problems of up to 25 cities indicate that 
NN2 performs the best of the three heuristics. 

Various heuristics based on mixed integer linear programming (MILP) 
formulations have also been proposed for the TDTSP. Vander Weil and Sahinidis 
separate the TDTSP into two sub-problems: one sub-problem containing additional 
consti-aints that place an upper bound on the ti-avel cost; and the other sub-problem 
containing additional constraints that form a lower bound. The algorithm attempts to 
solve each sub-problem and terminates when the upper and lower bounds are withm 
some user-defined value. Malandraki and Daskin disclose a MILP relaxation 
technique that removes many of the consti-aints found in the exact MILP formulation 
and then adds the constraints back as feasible solutions are found. The algorithm then 

re-solves the equations to see if the constraints hold, and the process continues until 

either no constraints remain or one of the constraints is violated. 

Malandraki and Dial describe a heuristic based on an exact dynamic 

programming algorithm that generates good solutions to TDTSPs of up to 55 cities 

using relatively little processor time, and the quality of the solutions are superior to 

that of the MILP relaxation technique. 

The scheduling systems of the prior art are ponderous and require large 
amounts of storage space and central processing unit (CPU) time, thus making them 
costiy and inefficient. Therefore, what is needed is a scheduling system that is 
capable of solving TSPs and TDTSPs economically. What is also needed is a 
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scheduling system that can - based upon the parameters and constraints present in the 
schedule - select the most appropriate heuristic for solving scheduling problems. 



Summary of the Tnvenfinn 

The present invention is directed to an economical scheduling system that is 
capable of choosing the most appropriate heuristic for solving time- dependent 
scheduhng problems. The present invention addresses these problems and others by 
combining several heuristic methods with a means for selecting the most appropriate 
method from enumerative or "brute force", dynamic programming, and genetic 
methods. 

The present invention includes a new dynamic programming (DP) heuristic 
that is capable of generating exactly the same solutions, using less memory and CPU 
time than the prior-art DP heuristics. The new heuristic outperforms the prior-art 
heuristic on problems with 50 or more cities and can generate good solutions on 
problems of up to 400 cities with reasonable processor and memory usage. This 
allows researchers to solve much larger TDTSPs, as the memory and CPU savings 
can be used to search a wider section of the solution space, which generally leads to 
better solutions. 

The prior-art exact DP solution to the TDTSP requires exponential CPU time 
and memory as the number of cities increases. These requirements cannot be met for 
any TDTSP with more than a few dozen cities. The restricted dynamic programming 
heuristic of the prior art reduces the above time and memory requirements by 
retaining at the end of each stage only a user-defined number of lowest-cost unique 
partial tours generated during a given stage. At any stage /, the user-defined number 
of lowest-cost unique partial tours is saved at the end of stage i-l and used to 
construct all possible tours that contain one additional city not yet visited. The 
designated number of lowest-cost partial tours is then saved to start the next stage. 

In contrast, the present invention makes use of hashing functions instead of 
sorting to identify duplicate values of the set of ches already visited and the current 
site to be visited as they are generated, thus reducing the amount of CPU time the 
heuristic needs. AVL trees are used to hold only the user-designated number of 
lowest-cost intermediate partial paths generated during each stage, thus resuUing in 
significant memory savings. With reasonable assumptions, the asymptotic running 



time of the heuristic of the present invention is the same as the prior-art heuristic, 
although the heuristic of the present invention though runs faster in almost all cases. 
In addition, the worst-case memory usage in the instant heuristic is better than that of 
the prior art heuristic for large numbers of sites. 

As previously noted, exact algorithms for a large number of real-world 
problems often require computing resources that are difficult or impossible to obtain. 
For many of these real- world problems, including the TDTSP, efficient algorithms 
have been developed which provide approximate solutions using reasonable amounts 
of resources. Rather than an exhaustive search of the solution space, most of this 
efficiency is obtained by performing only a limited search. Genetic Algorithms 
(GAs) are one method of directing this search. GAs are robust, stochastic algorithms 
that model the processes of evolution and Darwinian competition. The process of 
finding good solutions uses natural selection as a metaphor: better solutions survive 
and reproduce, with their positive characteristics mingling to form (hopefully) more- 
fit offspring. Less-fit solutions, on the other hand, die. While GAs make use of 
randomization in their search, they also can make use of the promising characteristics 
they find, making them especially popular for function optimization problems such as 
routing, scheduling, and other forms of tiansportation problems. 

Because genetic algorithms originally used biological processes as their 
inspiration, it is not surprising that many of the terms used to describe GAs come 
from their biological counterparts. The items in a genetic algorithm that represent 
solutions to the problem are called individuals or, alternatively, strings or 
chromosomes. A collection of these items is known as the population or pool. In 
general, each solution consists of a single chromosome and the chromosomes consist 
of genes at fixed positions within the chromosome called loci. Each gene controls 
one or more characteristics of the chromosome, and thus the value of the gene 
contributes information to the overall solution. The fitness of a particular 
chromosome, known as its phenotype, is defined by a user-supplied fitness function. 
This fitness fimction is the final judge of the solution quahty embedded in the 
chromosome. At each step of tiie genetic algorithm, individuals are evaluated 
according to the fitness function. A new population is then formed by selecting some 
number of the most-fit individuals from the current population for reproduction. 



The basic unit of a GA is a chromosome consisting of one or more genes that 
are represented as a variable length binary vector. By convention, GAs with genes 
that contain non-binary representations are referred to as evolutionary algorithms 
(EAs). The algorithms used in the present invention are evolutionary algorithms. 

The initial population for the GA can be created in many ways. Probably the 
simplest approach is to initialize the values of each of the genes randomly. Another 
alternative, used extensively in the present invention, is to have some other algorithm 
find an initial pool of good solutions which the GA can then attempt to improve. The 
GA module of the present invention includes an algorithm, operators, adaptive 
operator probabilities and population re-initiators. 

Finally, the invention includes a means for selecting among the enumerative, 
dynamic programming, and genetic modules to direct the scheduhng task to the 
module best suited for the task. 

Accordingly, one aspect of the invention is to provide a scheduling system for 
scheduling a plurality of time-dependent tasks, the scheduling system comprising: an 
enumerative "brute force" module; a dynamic programming module; a genetic 
module; and a parti tioner module for selecting one of said brute force module, said 
dynamic programming module, or said genetic module to generate a schedule for 
performing the plurality of time-dependent tasks. 

Another aspect of the present invention is to provide a dynamic programming 
module adapted to provide at least one solution for a scheduhng problem, having a 
hashing function capable of detecting duplicate solutions generated by the dynamic 
program module and a height-balanced binary tree for providing search insertion and 
deletion operations. 

Yet another aspect of the invention is to provide a scheduling system for 
scheduling a plurality of time-dependent tasks, the scheduling system comprising: an 
enumerative "brute force" module; a dynamic programming module adapted to 
provide at least one solution for a scheduling problem, having a hashing function 
capable of detecting duplicate solutions generated by the dynamic program module 
and a height-balanced binary tree for providing search insertion and deletion 
operations; a genetic module; a partitioner module for selecting one of the brute force 
module, the dynamic programming module, or the genetic module to generate a 



schedule for performing the plurality of time-dependent tasks; and a constraints file 
for providing an input to the partitioner module. 

These and other aspects of the present invention will become apparent to those 
skilled in the art after a reading of the following description of the preferred 
5 embodiment when considered with the drawing. 



Brief Description of the Drawing 

FIGURE 1 is a flow chart showing the relationship, in the present invention, 
between the enumerative module, dynamic programming module, genetic module and 
10 the selecting means. 



Detailed Description of the Preferred Embodiment 

In the following description, like reference characters designate like or 
corresponding parts in the schematic of the invention. Also in the following 

1 5 description, it is to be understood that any such terms as "forward," "rearward," "left," 
"right," "upwardly," "downwardly," and the like are words of convenience and are not 
to be construed as limiting terms. 

Referring now to Figure 1, it will be understood that the illustration is for the 
purpose of describing a preferred embodiment of the invention and is not intended to 

20 limit the invention thereto. As best seen in Figure 1, the scheduling system 10 

includes a brute force module 12, a djTiamic programming module 14, and a genetic 
module 16. A user-defined constraint file 18 is down loaded into the partition module 
20, which then evaluates the constraints and selects the module that is most suited to 
create the best schedule in the amount of time allowed by the user. The selected 

25 module then solves the problem, yielding an output 22 that represents the solution to 
the scheduling problem. 

The brute force module 12 simply searches (i.e., enumerates) every possible 
solution within the solution space. For example, the module 12 enumerates all of the 
following permutations for the letters a, b, and c: abc; acb; bac; bca; cab; and cba. The 

30 module 12 searches all of the permutations by performing the following steps: (1) 
cycling the first position through all the possible elements; (2) cycling the second 
position through all the remaining elements; (3) cycling the third position through all 
the remaining elements; and so on. The time it takes the brute force module to 
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examine a schedule increases exponentially as the number of tasks increases linearly, 
so using the brute force module is only feasible on relatively small problems. While 
the brute force module 12 is not practical for most real- world problems, as the search 
space is too large to be eniraierated, it produces high quality schedules - where the 
5 term "quahty" is by determined by a user-defined metric, such as the time required to 
complete the schedule or the amoimt of money required by the schedule - by 
examining every possible schedule permutation and then selecting the best overall 
schedule. 

An exact dynamic programming solution to the TDTSP requires exponential 
10 CPU time and memory as the number of cities increases. These requirements cannot 
be met for any TDTSP with more than a few dozen cities. The restricted dynamic 
programming heuristic of the prior art reduces the time and memory requirements by 
retaining at the end of each stage only the if lowest-cost unique partial tours generated 
during that stage, where //"is user-defined. In the present invention, for any stage i, 
1 5 each of the H lowest-cost unique partial toiirs saved at the end of stage i-l is used to 
construct all possible tours that contain one additional city not yet visited. For a 
TDTSP with n cities, there are H(n-i) partial tours constructed at each stage i. The H 
unique, lowest-cost partial tours are then saved to start the next stage. 

The prior-art dynamic prograrruning heuristic spends a significant amount of 
20 CPU time sorting to identify and eliminate duplicate values at the end of each stage. 
In contrast, the djmamic programming module of the present invention uses hash 
functions to detect when duphcate values have been generated. A hash array stores 
the H lowest-cost partial tours generated during each stage. Each tour's position in 
the hash array is determined by using a bit vector holding the key to a simple hash 
25 function. Double hashing with linear probing is used to resolve collisions. 

A new partial path is inserted into the hash array to pass the values of S and k 
to hash_l, a hash fimction that computes the initial position of the tour in the hash 
array. If a collision is detected at the position returned by hash_l, the DP module first 
determines whether the tour currently occupying that position in the hash array has 
30 the same values of S and k as the tour to be inserted. If so, the tour in the hash array is 
replaced only if the current tour has a lower cost, by the principle of optimality. 

If a collision is detected at the hash array position returned by hash_l but the 
values of and k are different, a second hash function, hash_2, is called to try a 
different position in the hash array. If another collision is detected in the hash array at 
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the position returned by hash_2, and the values of S and k differ, hnear probing is 
used. Linear probing continues until either duplicate values of S and k or an empty 
slot in the hash array is found. Collisions occur infrequently in practice, however, 
since both hash_l and hash_2 use the "division method" to distribute paths evenly in 
5 the hash array. The size of the hash array is a carefully chosen prime number not too 
near an exact power of 2, thereby additionally reducing the possibility of collisions. 

The prior-art dynamic programming heuristic uses temporary arrays to hold 
the partial paths generated during each stage. The size of these arrays represent a 
tradeoff between longer running times with higher memory usage, and overall 

1 0 solution quality. Larger arrays require more memory and take more CPU time to 
identify duplicates, but produce better solutions. Smaller arrays mean the heuristic 
can run faster, but produces lower-quality solutions. The dynamic programming 
module of the present invention avoids this tradeoff altogether by using AVL trees, in 
conjunction with the hashing procedures described above, thereby eliminating these 

1 5 temporary arrays and only storing the H lowest-cost partial paths generated during 
each stage. 

AVL trees are height-balanced binary trees that provide efficient search, 
insertion, and deletion operations while storing a large number of nodes. Each node 
in the AVL tree stores both the partial path cost and a pointer to the path's entry in the 

20 hash table structure. The partial path cost is used as the key value for comparisons. 
This enables the element in the tree with the worst cost to be determined by simply 
finding the rightmost node in the tree. 

When a new partial path is created during a stage, the DP module 14 of the 
present invention first computes the partial path's cost. If the cost is less than the H'^ 

25 worst-cost partial path already stored in the AVL tree, the modified heuristic then uses 
the hash functions to check whether the new path has the same values of S and k as 
any other path already stored. If the new partial path passes this inspection, it is 
inserted into the AVL tree and the hash array. The complete heuristic for the DP 
module is given in Table 1 . 

30 In the DP module 14 of the present invention, a partial path can be deleted 

from the AVL tree and hash array under certain circumstances. This occurs when H 
elements are aheady stored and a unique partial tour is generated which has a cost 
lower than that of the I^^ lowest-cost element in the hash array. In this situation, the 
element with the l/^ lowest-cost is deleted from the hash array and the AVL tree, and 
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the new partial tour is inserted. 

Table 1. The Dynamic Programming Heuristic 



StepO. |S|=0. 

Step 1. |S| = |S| + 1. If |Si =«, go to Step 8. 

Step 2. Compute the arrival times of partial tours in the current stage by adding to each partial 
tour of the previous stage one more node k, for all non- visited k. 

For each partial tour, if the partial arrival time is less than the partial arrival time of the worst 
retained partial tour in the current stage so far, go to Step 4. 

Step 3. If not all partial tours are examined yet, go to Step 2. Otherwise, go to Step 7. 

Step 4. Use the hash functions to determine if the S and k values of this partial tour are already 
stored in the hash array. If the values of S and k are unique, go to Step 5. 

If the values of 5 and k are the same as some other path already stored, and the partial arrival 
time of the new path is less than the stored partial arrival time, go to Step 6. 

Otherwise, go to Step 3. 

Step 5. Insert the partial path into the hash array and the AVL tree. Go to Step 3. 

Step 6. Delete the partial path with the higher cost from the AVL tree and hash array. Insert the 
new partial path in the same position in the hash array. Also insert the new path in the AVL tree. 
Go to Step 3. 

Step 7. Using the AVL tree and hash array, write on disk the values of A: and Pred for current 
stage. Go to Step 1. 

Step 8. Return to the depot from each partial tour and update the cost of each (now complete) 
tour m Cost. To trace back best solution tours, start with the final values of k and Pred for the 
lowest cost complete tours. Read from disk the tours' k and Pred entries in each previous stage 
until no more stages remain. 



5 When searching for duplicate values of 5" and k in the hash array, it is not 

sufficient to terminate the search when an empty slot in the hash array is found. 

To avoid this problem, an integer counter is attached to each slot in the hash 
array. The colUsion counter is set to zero at the beginning of every stage. Each time a 
collision occurs at a slot while attempting to insert an element, the colhsion counter at 
10 the slot is incremented. If the element at the slot is deleted during the stage, the 
collision counter at that slot is not reset. When inserting an element into the hash 
array, a new tour can immediately be placed into a slot only if the slot is empty and 
the collision counter at the slot is 0. If the slot is empty but the collision count is 
greater than 0, then the insertion algorithm knows that at least two other tours hashed 
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to slot earlier in this stage, and one of them may have been placed elsewhere in the 
hash array. One of these previous tours may still be in the hash array and contain the 
same values of S and k as the current tour. The insertion algorithm calculates the 
hash_2 position of the current tour to see whether a duplicate tour exists at that slot in 
5 the hash array. If the collision counter at that position is not zero, linear probing will 
be used to determine whether a duplicate tour exists. Only the next collision count 
slots need be examined using Hnear probing, since all colhsions from the hash_2 
function would have been resolved through linear probing. 

In terms of schedule quality, the dynamic programming module generally 

10 creates the next-best schedules, after the brute force module. The DP module 14 does 
not examine every schedule permutation, so it is not guaranteed to return the optimum 
schedule. The DP module 14, however, is able to work with a larger number of tasks 
than is the BF module 12. Where the time vs. quality tradeoff favors time, the DP 
module 14 is generally the best choice. The DP module 14 also requires a larger 

15 amount of computing resources as the number of tasks increases. Where insufficient 
resources are available, the genetic module 1 6 is used. 

The genetic module 16 is generally used when the computing resources 
available (e.g., memory, disk space, processor speed, or time) precludes the use of the 
other modules. While the quality of the solutions generated by the genetic module is 

20 generally lower than that of the other modules, the genetic module 16 can generate 
schedules for many more tasks. In addition, the genetic module 16 may produce 
higher quality schedules than the other modules when the number of constraints on 
the tasks is high. 

The genetic module 16 of the present invention includes a genetic algorithm 
25 (GA) which implements eight well-known genetic operators, plus adaptive operator 
probabilities and population re-initiahzation mechanisms to determine which 
combination of operators and mechanisms produces the best solutions to a randomly 
generated TDTSP. The GA is started by creating an initial solution using a dynamic 
programming (DP) heuristic. This heuristic avoids the exponential CPU and memory 
30 requirements of an exact DP algorithm by retaining in memory only a user-defined 
number of partial solutions. Retaining more partial solutions generally results in 
better overall solutions, and storage of tens of thousands of partial solutions to 
generate good results is not uncommon. In the GA of the preferred embodiment, the 
DP heuristic is allowed to retain 10 partial solutions in memory at each stage. This 
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initial solution is added to the GA population, where the chromosomes are 
permutations of the n-1 integers representing the tasks to be scheduled. The 
remaining members of the population are initiaUzed with random paths. 

In the preferred embodiment, binary tournament selection is used to select 
5 members of the population for reproduction. Either one or two parents are chosen, 
depending on the operator selected for that generation. Operator selection is 
performed randomly where the likelihood of an operator being selected is determined 
by its associated probability. 

During each generation, the decision of whether to retain a new individual o in 

10 the population is made using a (P+l) reproduction approach. The costs of o and q, the 
member of the population with the highest cost tour, are compared and if o has a 
lower cost than q, then q is deleted from the population and o retained. 

The operators chosen for the GA of the preferred embodiment have been 
shown to be effective on either the TSP or vehicle routing problems similar to the 

1 5 TDTSP. A variety of mutation and local search operators have been implemented, 
and a brief description of each of the operators used follows. The term "cities" is 
used in the following discussion as an example of a travel-related scheduhng problem, 
and is not intended to limit the present invention. In general, any type of time- 
dependent task can be scheduled. 

20 Edge Recombination (ER): Edge recombination has been shown to be 

effective on certain kinds of scheduling problems. Edge recombination produces a 
single offspring from two parent paths. The GA of the present invention implements 
a modified version of edge recombination in which a greedy heuristic, rather than 
random selection, is used to resolve ties when recombination becomes blocked. The 

25 greedy heuristic estimates the cost of visiting each of the remaining unvisited cities 
from the current city. The remaining city with the lowest cost becomes the next city 
to be visited, and edge recombination resumes. 

Merge Crossover (MX): Originally proposed for vehicle routing problems, 
merge crossover seeks to preserve in one offspring any global precedence of cities 

30 found in the offspring's two parents. That is, for any two cities i and j, if city i 
appears before city J in both parents, then city i must appear before city j in the 
offspring. While some implementations receive global precedence information from 
an external source (e.g., a global precedence table), the implementation in the 
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preferred embodiment seeks to discover global precedents in the parents instead of 
using an external table. 

Cycle Crossover (CX): Cycle crossover produces a single offspring from two 
parent paths and is designed to preserve in the offspring the absolute position of each 
5 city in the parents. Thus, any city k in position m in the offspring must also appear in 
position m in one of the parents. 

Scramble Sublist Mutation (SSM): Scramble subhst mutation produces one 
offspring from one parent by randomly selecting a sublist of cities from the parent and 
randomly repositioning the cities within the subhst of the offspring. 
1 0 Uniform Order-based Mutation (UOM): Uniform order-based mutation is a 

unary operator that works by exchanging in the offspring the positions of two 
randomly selected cities in the parent. 

Non-Uniform Order-based Mutation (NOM): Similar to uniform order- 
based mutation, the non-uniform variant also produces one offspring from one parent. 
1 5 In the non-uniform version, however, the average difference between the positions of 
the two cities to be swapped decreases as the number of generations processed 
increases. The implementation in the GA of the preferred embodiment begins by 
selecting one city at random. The position of the second city to be swapped is 
calculated using the following ftmction adapted from: 



where y = « - 1, r is a random number in [0,1], Tis the maximal generation number, t 
is the current generation number, and ^ is a user-defmed parameter used to control the 
degree of nonuniformity. In the preferred embodiment, the value of b is set 1 .4 for 
our implementation. 



a scramble sublist mutation operator. While scramble sublist randomizes the 
positions of cities within a subhst of the offspring's path, the uniform local search 
operator computes the cost of every permutation of the cities in a parent's sublist, then 
assigns to the offspring the one sublist permutation which minimizes the overall cost 
30 of the tour. 

While the uniform local search operator is guaranteed to find the lowest cost 
permutation, the processing time of the operator grows factorially as the length of the 
sublist grows linearly. The GA the preferred embodiment therefore uses a subhst of 



20 




25 



Uniform Local Search (ULS): The uniform local search operator is based on 
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length 6, and thus evaluates a total of 720 permutations each time the uniform local 
search operator is called. 

Non-Uniform Local Search (NLS): Unlike a uniform local search, the cities 
selected by the non-uniform local search operator are chosen randomly from the entire 
5 path. In this manner, each permutation of the selected cities is created and the 
corresponding path cost is calculated. The offspring is assigned the path 
corresponding to the permutation of the selected cities that minimizes the overall cost 
of the tour. As with the uniform local search operator, non-uniform local search 
works with just 6 cities to keep the CPU time required by this operator at a reasonable 
10 level. 

In addition to the operators described above, the GA of the preferred 
embodiment implements two special-purpose mechanisms to test their effectiveness 
on the TDTSP: adaptive operator probabilities and population reinitialization. Using 
adaptive operator probabilities allows the GA to adjust the relative probabilities of 

1 5 each operator according to how much relative improvement that operator has 

contributed to the current population. The GA implements an adaptive operator 
probabilities (ADOPP) mechanism. A brief discussion of how ADOPP adjusts each 
operator's probabilities follows. 

For each offspring created that has a cost lower than the median cost of the 

20 current population, ADOPP assigns credit to each operator that helped build that 
offspring, where the amount of credit assigned is a user-defmed constant. The 
operator that directly creates the improved offspring, known as the immediate 
operator, gets the maximum amount of credit, while the operators that generated the 
offspring's parents get some reduced amount of credit. Credit can be assigned to 

25 several generations of ancestors, where the number of ancestor generations and rate of 
credit decay are user-defmed. 

Since ADOPP must assign credit to each operator that contributes to a fit 
offspring, ADOPP keeps track of an operator tree for each member of the current 
population. This operator tree records the operators that generated the individual and 

30 its ancestors for a fixed number of prior generations. When a binary operator is 
applied, for example, ADOPP copies the operator trees of each parent into the left and 
right subtrees of the offspring's operator tree, discarding each parent's leaf nodes. 
The current operator becomes the new root. In the preferred embodiment, the GA 
records a maximum of four generations of ancestor operators for each offspring. 
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In addition to operator trees, ADOPP also maintains a queue that keeps track 
of each operator's contributions to the population for some user-defined number of 
most recent previous generations. After a new individual is added to the population, 
ADOPP recomputes the probability of selection of each of the m operators in the next 
5 generation according to the following formula: 

Probability of operator op = / E ^ 

N[op] ^iN{i] 

To ensure that all operators continued to participate in the GA, the minimum 
probability of any operator is preferably set to 5%. 

In addition to adaptive operator probabilities, the GA also implements the 

1 0 "population reinitiahzation" mechanism. Population reinitialization is a method of 
introducing diversity into a population that may have converged prematurely. 
Reinitialization works by creating a new population where only a few of the best 
individuals from the old population are copied to the new, and the rest of the new 
population is created at random. This mechanism has been shown to give good 

1 5 results on problems that use small population sizes. The implementation of 

reinitialization copies only the individual with the lowest overall cost from the old 
population into the new. In the preferred embodiment, reinitialization takes place 
once 2,500 generations have passed without a new member having been added to the 
population. 

20 After a pool P of schedules is created, each of the schedules in P must be 

evaluated to the schedule's fitness. The enumerator module 12, dynamic 
programming module 14, and genetic module 16 include a schedule - or fitness 
function - evaluator. In the example fitness function shown below in Table 2, the 
cost of a given schedule is measured in minutes, and consists of three parts: the time it 

25 takes to walk to the ride, plus the time the customer can expect to wait in line at each 
ride, plus the number of minutes the ride lasts. 
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Table 2. A Sample Fitness Function 



Function Cost(;j, W, D, R, t^, t„, w^) 
Begin 

Initialize tour cost to 0 

Initialize clock to 4, the customer's arrival time at the park 

If ta = park opening time to then 
tonr_cost = tour_cost + (walk time from end of Main Street to first ride * w^) 
clock = clock + (walk time from end of Main Street to first ride * 

Else 

toiir_cost = tour_cost + (walk time from park entrance to first ride * Wy^) 
clock = clock + (walk time from park entrance to first ride * w„) 
Endif 

For each ride rmpdo 

tour cost = tour_cost + (wait time at r * w„) 
clock = clock + (wait time at r * Wa) 

tour_cost = tour_cost + ride time at r 
clock = clock + ride time at r 

If r is not the last ride in p then 
tour_cost = tour_cost + walk time from r to next ride in p 
clock = clock + walk time from r to next ride in p 
Endif 
Done 



The cost function accepts the following input parameters: 
p: a TP in P 
5 W: the wait time matrix 

D: the distance matrix 
R: the ride time matrix 

ta. the time of day the customer will arrive at the park. 
td.: the time of day the customer will depart the park. 
10 to: the time of day the park will open. 

Ww. the relative preference the customer has for walking versus waiting 
in line. 

Wa. the relative preference the customer has for waiting in line versus 
walking. 

15 

It is important for the heuristics to be able to generate solutions to constrained 
TDTSPs because many real-world problems include constraints. The constraint file 
1 8 includes those constraints to be considered in obtaining a solution to a scheduling 
problem. In the Preferred Embodiment, both the dynamic programming heuristic and 
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genetic algorithm are modified to satisfy two different types of constraints for the 
TDTSP. 

Two obvious types of constraints for the TDTSP - precedence constraints and 
time windows - are considered in the Preferred Embodiment. The precedence 
5 constraints impose a partial order on two or more cities within a given solution, and 
are stated as rules of the form "City x must be visited before city >>", where x and y 
^ 0. Time windows, on the other hand, are constraints that specify the range of time 
during which it is permissible to perform a given task (e.g., "Visit city 41 between 
2:00 p.m. and 4:00 p.m.). The time window starts at the arrival time, and expires after 
1 0 the time window duration has expired. 

There are several common ways for genetic algorithms to handle constraints: 
penalty functions, repair methods, and specialized operators. Penalty functions are 
the most frequently implemented method of handling constraints in GAs. In its 
simplest case, a penalty function has the form: 



where the penalty function evaluates to zero if no constraints are violated. This basic 
penalty function provides great latitude in the computation of an appropriate penalty 
to impose for violated constraints. Static methods assign different penalties to 

20 constraint violations based upon the severity of the violation, whereas dynamic 

penalty functions, impose larger penalties on infeasible solutions as the number of 
generations processed increases. In the preferred embodiment of the present 
invention, a static penalty function in which the penalty function assigns different 
levels of penalty based on the severity of the violation is implemented. For example, 

25 a candidate solution that violates a single time window constraint by only a few 

minutes is penalized much less severely than a candidate solution that violates a time 
window constraint by several hours. Similarly, candidate solutions that violate both 
precedence constraints and time window constraints are penalized more than solutions 
that violate only precedence constraints. The complete penalty function is: 
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penalty(x), otherwise 



if X is feasible 



30 



Penalty(x) = (Number of Precedence Constraints Violated * 

Precedence_Constraint_Violation_Penalty) + [(Number of Time 
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Window Constraints Violated * 

Tinie_Window_Constraint_Penalty) + Total Number of Minutes 
Time Windows Were Missed] 

5 where Time_Window_Constraint_Penalty and 

Precedence _Constraint_Violation_Penalty are user-defined constants. 

One of the attributes of a good penalty function is that the fitness of all 
infeasible solutions should be worse than the least-fit feasible solution. This attribute 

10 ensures that any feasible solution will be chosen for reproduction more often than any 
infeasible one. To implement this, a static penalty of 10,000 minutes is added to all 
infeasible solutions. 

The partitioner module (PM) 20 is the module responsible for deciding 
whether the brute force, dynamic programming, or genetic module will generate the 

15 schedule. The PM 20 receives input from the constraints file 18. The input includes 
the number of tasks to be scheduled and the maximum amount of time allowed to 
generate the schedule. In addition, a hardware resource calculator generates input for 
the PM 20 concerning the amount of available physical memory and disk space. 

The PM 20 first generates a small number of schedule permutations (e.g., 100 

20 or 1000 possible schedules) using the BF 12 module. Based on the time it takes the 
BF module 12 to process this small number of schedules, the PM 20 estimates T, the 
time the BF module would require to generate all the schedule permutations for the 
number of tasks to be schedule. If Tis less than the maximum amount of time the 
computer is allowed to take to generate the schedule, the PM 20 selects the BF 

25 module 12 to produce the schedule. Otherwise, the PM 20 goes to the second step. 

In the second step, the partitioner module 20 starts the DP module and times 
how long the DP module 14 takes to schedule a small number of tasks. The PM 20 
also watches the DP module 14 to estimate how much memory and disk space the DP 
module 14 would require computing the entire schedule. If the DP module's 14 

30 resource requirements can be met and the schedule can be complete in the time 

allotted, the DP module 14 is selected. Otherwise, the genetic module 16 is selected. 

Certain modifications and improvements will occur to those skilled in the art 
upon a reading of the foregoing description. By way of example, transportation and 
scheduling problems could include a "balking factor" constraint. This "balking 
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factor" would represent the maximum amount of time the user is willing to wait for a 
given task to be completed. For example, a user may specify that he or she wants to 
go from point A to point B, but only if he or she does not get stuck in traffic for more 
than 45 minutes. In this example, 45 minutes is the "balking factor." Also, each task 
5 may include an optional priority (e.g., high, medium, or low), and the user-defined 
fitness function may, in a straightforward fashion, determine which schedule is most 
acceptable, taking into account the possible tradeoffs between schedule efficiency and 
task priority. For example, if the user specifies that ten tasks must be scheduled during 
a five hour span, but it is impossible to complete all ten tasks in five hours, the 

1 0 scheduler can try to ensure that the highest-priority tasks get accomplished during the 
five hour span, leaving lower-priority tasks out of the schedule. In addition, it is 
straightforward to add or remove constraints or tasks dynamically (i.e., "on the fly"), 
and have the scheduler restart or re-do the schedule. It should be understood that all 
such modifications and improvements have been deleted herein for the sake of 

1 5 conciseness and readability but are properly within the scope of the following claims. 
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I claim: 



1 . A scheduling system for scheduling a plurality of time-dependent 
tasks, said scheduling system comprising: 

5 (a) an enumerative brute force module; 

(b) a dynamic programming module; 

(c) a genetic module; and 

(d) a partitioner module for selecting one of said brute force 
module, said dynamic programming module, or said genetic 

10 module to generate a of said plurality of time-dependent tasks. 

2. The scheduling system of Claim 1 further comprising a constraints file, 
said constraints file providing an input to said partitioner module. 

15 3. The scheduling system of Claim 2, wherein said constraints file 

includes at least one predetermined time constraint. 

4. The scheduling system of Claim 3, wherein said predetermined time 
constraint fiirther includes at least one constraint selected from the group consisting 

20 of: 

(a) a precedence constraint, wherein said precedence constraint limits 
scheduling of said tasks according to a predetermined order of 
occurrence in time; 

(b) a time window constraint, wherein said time window constraint limits 
25 scheduling of said tasks within a time window of a predetermined 

length; 

(c) a priority constraint, wherein said priority constraint limits scheduling 
of said tasks to a sequence according to a predetermined priority; and 

(d) a conditional constraint, wherein said conditional constraint limits 
30 scheduling of said tasks based on an occurrence of at least one event. 

5. The scheduling system of Claim 1, wherein said brute force module 
includes a task list, a schedule permutation generator, and a schedule evaluator. 
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6. The scheduling system of Claim 5, wherein said schedule permutation 
generator includes a first algorithm, said first algorithm enumerating each possible 
permutation of the time dependent tasks in a schedule. 



5 7. The scheduling system of Claim 5, wherein said schedule evaluator is 

an efficiency evaluator. 

8. The scheduling system of Claim 7, wherein said efficiency evaluator 
includes at least one parameter selected fi-om the group consisting of a time 

1 0 parameter, a cost parameter, and a user-defined parameter. 

9. The scheduling system of Claim 7, wherein said efficiency evaluator 
includes a second algorithm, said second algorithm determining an efficiency of each 
task based on a position of said task in a schedule. 

15 

10. The scheduling system of Claim 1, wherein said dynamic 
programming module includes a task list, a dynamic programming schedule 
permutation generator, and a schedule evaluator. 

20 11. The scheduling system of Claim 10, wherein said dynamic 

programming schedule permutation generator includes a third algorithm, said third 
algorithm: 

(a) designating a number of number of tasks to store in memory at a given 
time; 

25 (b) placing the number of tasks in an order of efficiency; and 

(c) determining whether a task outside of the number of tasks is more 
efficient than an a task within the number of tasks. 

12. The scheduling system of Claim 1 0, wherein said schedule evaluator is 
30 an efficiency evaluator. 

13. The scheduling system of Claim 12, wherein said efficiency evaluator 
includes a parameter selected fi-om the group consisting of a time parameter, a cost 
parameter, and at least one user-defined parameter. 
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14. The scheduling system of Claim 12, wherein said efficiency evaluator 
includes a fourth algorithm, said fourth enumerating each possible permutation of the 
time dependent tasks. 

15. The scheduling system of Claim 1, wherein said genetic module 
includes a task list, a genetic schedule permutation generator, and a schedule 
evaluator. 



10 16. The scheduling system of Claim 15, wherein said genetic schedule 

permutation generator includes a fifth algorithm, said fifth algorithm mating a first 
schedule and a second schedule to breed a third schedule. 



17. The scheduling system of Claim 15, wherein said schedule evaluator is 
15 an efficiency evaluator. 



1 8. The scheduling system of Claim 17, wherein said efficiency evaluator 
includes at least one parameter selected firom the group consisting of a time 
parameter, a cost parameter, and a user-defined parameter. 

20 

19. The scheduling system of Claim 17, wherein said efficiency evaluator 
includes a sixth algorithm, said sixth algorithm enumerating each possible 
permutation of the time dependent tasks. 



25 20. The scheduling system of Claim 1, wherein said partitioner module 

includes a brute force partitioner and a residual evaluator. 



2 1 . The scheduling system of Claim 20, wherein said brute force 
partitioner includes a brute force time completion estimator. 

30 

22. The scheduling system of Claim 21 , wherein said brute force time 
completion estimator includes a seventh algorithm, said seventh algorithm: 

(a) generating a given number of schedule permutations using the 
brute force module; 
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(b) estimating a time to complete all possible schedule 

permutations using the brute force module based on the time 
taken to generate the given number of schedule permutations; 
and 

5 (c) determining whether the estimated time to complete all possible 

schedule permutations using the brute force module exceeds a 
given time limit. 



23. The scheduling system of Claim 20, wherein said residual evaluator 
10 includes a time completion estimator for said dynamic program module and said 
genetic module. 
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24. The scheduling system of Claim 23 further including a hardware 
resource evaluator. 

25. The scheduling system of Claim 24, wherein said hardware resource 
evaluator includes a memory module and a central processing unit. 



26. The scheduling system of Claim 23, wherein said residual evaluator 
20 includes an eighth algorithm, said eighth algorithm: 

(a) generating a given number of schedule permutations using the 
dynamic programming module; 

(b) estimating a time to complete all possible schedule 
permutations using the d3^amic programming module based on 

25 the time taken to generate the given number of schedule 

permutations; and 

(c) determining whether the estimated time to complete all possible 
schedule using the dynamic programming module permutations 
exceeds a given time limit. 

30 

27. A dynamic programming module adapted to provide at least one 
solution for a scheduling problem, said dynamic programming module including: 
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(a) a hashing function, said hashing function being capable of 
detecting duplicate solutions generated by said dynamic 
program module; and 

(b) a height-balanced binary tree for providing search insertion and 
deletion operations. 

28. A scheduHng system for scheduling a plurality of time-dependent 
tasks, said scheduling system comprising: 

(a) an enumerative brute force module; 

(b) a djmamic programming module, said dynamic programming 
module including a hashing fiinction, said hashing function 
being capable of detecting duplicate solutions generated by said 
dynamic program module and a height-balanced binary tree for 
providing search insertion and deletion operations; 

(c) a genetic module 

(d) a partitioner module for selecting one of said brute force 
module, said dynamic programming module, or genetic module 
to generate a schedule for selecting said plurality of time- 
dependent tasks; and 

(e) a constraints file, said constraints file providing an input to said 
partitioner module. 

29. The scheduling system of Claim 28, wherein said constraints file 
includes at least one predetermined time constraint. 

30. The scheduling system of Claim 29, wherein said predetermined time 
constraint further includes at least one constraint selected from the group consisting 
of: 

(a) a precedence constraint, wherein said precedence constraint limits 
scheduling of said tasks according to a predetermined order of 
occurrence in time; 

(b) a time window constraint, wherein said time window constraint limits 
scheduling of said tasks within a time window of a predetermined 
length; 
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(c) a priority constraint, wherein said priority constraint limits scheduling 
of said tasks to a sequence according to a predetermined priority; and 

(d) a conditional constraint, wherein said conditional constraint limits 
scheduling of said tasks based on an occurrence of at least one event. 

3 1 . The scheduling system of Claim 28, wherein said brute force module 
includes a task hst, a schedule permutation generator, and a schedule evaluator. 



32. The scheduling system of Claim 3 1 , wherein said schedule permutation 
1 0 generator includes a first algorithm, said first algorithm enumerating each possible 
permutation of the time dependent tasks in a schedule. 



33 . The scheduling system of Claim 3 1 , wherein said schedule evaluator is 
an efficiency evaluator. 

15 

34. The scheduling system of Claim 33, wherein said efficiency evaluator 
includes at least one parameter selected from the group consisting of a time 
parameter, a cost parameter, and a user-defined parameter. 



20 35. The scheduling system of Claim 33, wherein said efficiency evaluator 

includes a second algorithm, said second algorithm determining an efficiency of each 
task based on a position of said task in a schedule. 

36. The scheduling system of Claim 28, wherein said dynamic 
25 programming module includes a task list, a dynamic programming schedule 

permutation generator, and a schedule evaluator. 

37. The scheduling system of Claim 36, wherein said dynamic 
programming schedule permutation generator includes a third algorithm, said third 

30 algorithm: 

(a) designating a number of number of tasks to store in memory at a given 
time; 

(b) placing the mmiber of tasks in an order of efficiency; and 
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(c) determining whether a task outside of the number of tasks is more 
efficient than an a task within the number of tasks. 

38. The scheduHng system of Claim 36, wherein said schedule evaluator is 
5 an efficiency evaluator. 

39. The scheduUng system of Claim 38, wherein said efficiency evaluator 
includes a parameter selected from the group consisting of a time parameter, a cost 
parameter, and at least one user-defined parameter. 

10 

40. The scheduling system of Claim 38, wherein said efficiency evaluator 
includes a fourth algorithm, said fourth enumerating each possible permutation of the 
time dependent tasks. 

15 41 . The scheduhng system of Claim 28, wherein said genetic module 

includes a task list, a genetic schedule permutation generator, and a schedule 
evaluator. 

42. The scheduling system of Claim 41, wherein said genetic schedule 
20 permutation generator includes a fifth algorithm, said fifth algorithm mating a first 

schedule and a second schedule to breed a third schedule. 

43. The scheduling system of Claim 41, wherein said schedule evaluator is 
an efficiency evaluator. 

25 

44. The scheduling system of Claim 43, wherein said efficiency evaluator 
includes at least one parameter selected from the group consisting of a time 
parameter, a cost parameter, and a user-defined parameter. 

30 45. The scheduling system of Claim 43, wherein said efficiency evaluator 

includes a sixth algorithm, said sixth algorithm enumerating each possible 
permutation of the time dependent tasks. 
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46. The scheduling system of Claim 28, wherein said partitioner module 
includes a brute force partitioner and a residual evaluator. 



47. The scheduling system of Claim 46, wherein said brute force 
5 partitioner includes a brute force time completion estimator. 

48. The scheduhng system of Claim 47, wherein said brute force time 
completion estimator includes a seventh algorithm, said seventh algorithm: 

(a) generating a given number of schedule permutations using the 
10 brute force module; 

(b) estimating a time to complete all possible schedule 
permutations using the brute force module based on the time 
taken to generate the given number of schedule permutations; 
and 

1 5 (c) determining whether the estimated time to complete all possible 

schedule permutations using the brute force module exceeds a 
given time limit. 

49. The scheduling system of Claim 46, wherein said residual evaluator 
20 includes a time completion estimator for said djniamic program module and said 

genetic module. 

50. The scheduling system of Claim 49 further including a hardware 
resource evaluator. 

25 

5 1 . The scheduling system of Claim 50, wherein said hardware resource 
evaluator includes a memory module and a central processing unit. 

52. The scheduling system of Claim 49, wherein said residual evaluator 
30 includes an eighth algorithm, said eighth algorithm: 

(a) generating a given number of schedule permutations using the 
dynamic programming module; 

(b) estimating a time to complete all possible schedule 
permutations using the dynamic programming module based on 
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the time taken to generate the given number of schedule 
permutations; and 
(c) determining whether the estimated time to complete all possible 
schedule using the dynamic programming module permutations 
exceeds a given time limit. 



53. A method for scheduling a plurality of time-dependent tasks, said 
method comprising the steps of: 

(a) providing an input to a partitioner module; 
1 0 (b) selecting a scheduhng module from the group consisting of: an 

enumerative brute force module; a dynamic programming 
module; a genetic module; and 
(c) generating a schedule. 

15 54. A method for scheduling a plurahty of time-dependent tasks, said 

method comprising the steps of: 

(a) providing an input to a partitioner module; 

(b) selecting a scheduling module from the group consisting of: an 
enumerative brute force module; a dynamic programming 

20 module, said dynamic programming module including a 

hashing fimction, said hashing function being capable of 
detecting duplicate solutions generated by said dynamic 
program module and a height-balanced binary tree for 
providing search insertion and deletion operations; a genetic 

25 module; and 

(c) generating a schedule. 
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Abstract 

A scheduling system for choosing the most appropriate heuristic for solving 
time-dependant scheduling problems. The invention includes a means for selecting 
the most appropriate heuristic method for generating a schedule from an enumerative 
("brute force") method, a dynamic programming method, and a genetic method. The 
invention further includes abashing function that is capable of detecting duphcate 
solutions generated by the dynamic programming module and a height-balanced 
binary tree for providing search insertion and deletion operations. 
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